UNCLASSIFIED 


AD  NUMBER:  AD0824036 

_ LIMITATION  CHANGES 

TO: 

Approved  for  public  release;  distribution  is  unlimited. 


FROM: 


Distribution  authorized  to  U.S.  Gov't,  agencies  and  their  contractors; 
Export  Control;  1  Nov  1967.  Other  requests  shall  be  referred  to  Air  Force 
Rome  Air  Development  Center,  EMIRC,  Griffiss  AFB,  NY  13440. 


_ AUTHORITY 

RADC,  USAF  LTR,  17  SEP  1971 


THIS  PAGE  IS  UNCLASSIFIED 


Aut one trio 
Alexandria,  Virginia 


RECONNAISSANCE  COLOR  EVALUATION 


4.  HKil*TI«|IWTnf«|M*fMpf«N<IMhllnM«) 

Final  Technical  Report  1  March  1966  to  30  September  196 


r  am  gi-Tii  rriM  rr* 


Maurice  B.  Foley 
Milton  L.  Smith 


r  m.  t  n  i’ll 


OATS 

November  1967 


CONTRACT  On  «MAM Tl._. 

AF  30 (602). 4096 

fc  Nwicr  mm. 

6244 


stsf 


ORIO«NATOR*I  Itfti 


FR-67-3101 


■•TiTTT.T  l rnrrm 


TR-67-593 


a  subjeot  to  special  export  controls  and  each  trans¬ 
mittal  to  foreign  governments  or  foreign  national  or  representatives 
there  of  may  be  made  only  with  prior  approval  of  RADC(BMIRC)  ,GAF9,  NT. 


irrjjr  "Tt  •  -w  r — rY/TrJTTl  PH 


RADC  Project  Engineer: 
William  R.  Dyer  (B«RC) 
AC 


e  Air  Development  Center  (EMXRC) 
fflss  Air  Force  Base,  Maw  fork 


•HI- mu  IM-hHim  -iii  iiHin  1 1 1  i  nmn  ii»'l(i—i-  -lit!  'll  "4<  h>i  1 1  Itmti  1 1  HlHlMh  iHI-tl  mil  mi  n 


II  I  HI  1 1444.1  111  llllllt  ilMIHi  iiimmilll-H-l'mi"ll-^M<4='mill*— tlulH4tl*4IMi  Itt.m*n—n 


RECONNAISSANCE  COLOR  EVALUATION 


Maurice  E,  Foley 
Milton  L.  Smith 

Autometric /Raytheon  Company 


This  document  is  subject  to  special 
export  controls  and  each  transmittal 
to  foteisn  governments,  foreign  na¬ 
tionals  or  representatives  thereto  may 
be  made  only  with  prior  approval  of 
RADC  (EMIRC),  GAFB,  N-Y.  1344(1 


AFLC,  GAFB,  I.T.,  13  Dec  6?-T3 


FOREWORD 


Automot rio/Ray  thnon  Company  ,  Alexandria  ,  V:l rgl  r.la  ,  Is 
pleased  to  submit  this  Final  Report  on  Contract;  AP  30(  602)~4096 
Proj e c  t  6 244  ,  H E C ON N A I S 3 A N C E  C 0 LC R  E V A L U A T 1 0 N,  t; o  R ::> m e  A .1  r 
Development  Center .  The  report  is  divided  into  five  sections : 
Introduction,  Imagery  ami  Information  Survey ,  Test  Design  and 


Administration,  Test  Summary,  and  Cone  lust  jns  and  Recommenda¬ 
tions  .  The  Introduction  covers  the  objectives  and  scope  of 
the  program.  The  next  two  sections  cover*  the  preparatory 
investigations  made  and  the  testing  rationale  forthcoming  from 
them.  Difficulties  met  are  also  described,  not  to  reflect 
negatively  on  the  directing  or  cooperating  organizations,  but 
to  give  a  complete  conception  of  the  program.  In  the  Test 
Summary  section,  the  test  conducted  and  Its  results  are  dis¬ 
cussed  in  detail.  Conclusions  and  recommendations  based  on 
the  test  results  are  Included  in  the  final  section. 


We  wish  to  acknowledge  specifically  Mr.  William  R.  Dyer, 
EMIRC,  RADC  Project  Engineer,  for  his  overall  guidance  of  this 
program  and  Dr.  Wallace  Knetz  of  American  Institutes  for  Research 
for  his  professional  contributions  in  test  design  and  data 
analysis.  Though  it  Is  impossible  to  acknowledge  personally 
all  those  others  who  aided  our  efforts,  we  wish  to  acknowledge 
the  cooperation  of  the  following  organizations  which  contrib¬ 
uted  substantially  to  the  success  of  this  program  by  making 
film  collections  available:  The  Photogrammetric  Division  of 
the  U.S.  Coast  and  Geodetic  Survey,  the  U.S.  Naval  Reconnaissance 
Technical  Support  Center,  the  U.S.  Army  Electronics  Laboratory 
and  their  supporting  contractor,  Goodyear  Aerospace  Corporation, 
U.S.  Army  Intelligence  Materials  Development  Office,  Cornell 
Aeronautical  Laboratories ,  the  Geographic  Systems  Division  of 
the  U.S.  Army  Engineer  Topographic  Laboratory,  and  the  Color 
Committee  of  the  American  Society  of  Photogrammetry .  Acknowl¬ 
edgement  is  also  made  of  the  technical  assistance  and  coopera¬ 
tion  readily  extended  to  Autometrlc/Raytheon  in  the  course  of 
this  program  by  Eastman  Kodak  Company,  the  Richards  Corporation, 
and  Data  Corporation. 

Information  in  this  report  is  embargoed  under  the  Depart¬ 
ment  of  State  ITIARs .  This  report  may  be  released  to  foreign 
governments  by  departments  or  agencies  of  the  U.S.  Government 
subject  to  approval  of  RADC  or  higher  authority  within  the 
Air  Force.  Private  Individuals  or  firms  require  a  Department 
of  State  export  license. 
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ABSTRACT 


This  report  documents  the  testing  program  conducted  tv 
Autometric/Raytheon  Company  under  Contract  AF  30(602) -4096, 
RhCONNAI SSANCR  ^  COLOR  F.VAUJAT  I  ON  „  The  objectives  of  the  program 
were  t:o  "cTe t e rm T he" ~Th e  relative  usefulness  of  color  photography 
in  aerial  reconnaissance  as  compared  to  panchromatic  photography, 
and  to  male  appropriate  specific  recommendations  for  application 
of  color  photography  in  aerial  reconnaissance  operations.  No 
decisive  advantages  for  either  type  of  photography  were  found  in 
the  test  program.  Use  of  color  imagery  increased  the  speed  of 
interpretation  in  both  search  and  analysis  tasks  to  a  modest 
degree,  and  caused  a  small  improvement  in  completeness  in  search 
tasks  where  hue  was  a  factor  differentiating  target  from  back¬ 
ground.  However,  accuracy  of  analysis  of  color  photography 
tended  to  be  lower  thin  that  for  panchromatic  when  photo  scale 
was  small  or  marginal  in  relation  to  target  size.  Application 
of  color  photography  is  recommended  in  reconnaissance  situations 
where  color  is  expected  to  be  a  strong  clue  to  desired  informa¬ 
tion,  small  time  savings  are  significant,  and  collection  of 
medium  to  large  scale  imagery  is  feasible.  Investigations  of 
ways  and  means  of  increasing  the  modest  advantages  found  for 
color  films  are  also  recommended. 
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INTRODUCTION 


I  . 

This  report  documents  the  work  accomplished  under  Air 
Force  Contract  AF  30 (602) -4096 ,  RECONNAISSANCE  COLOR  EVALUATION , 
between  March  1966  and  August  1967.  Data  collected  in  testing 
performed  under  this  contract  is  included,  along  with  conclusions 
and  recommendations  based  on  the  test  results. 

1 . 1  Initial  Program  Objectives 

The  program  objectives  wen  originally  as  follows: 

(1)  To  determine,  by  appropriate  tests  of  interpreta¬ 
tion  speed,  accuracy  and  completeness: 

(a)  Those  imagery  interpretation  operations  for 
which  color  photographic  technology  has  the 
greatest  potential. 

(b)  The  relative  usefulness  of  color  and  panchro¬ 
matic  imagery  in  selected  interpretation  oper¬ 
ations,  including  rapid  screening  and  target 
chang i  detection. 

(c)  The  degree  to  which  the  usefulness  of  color 
imagery  is  influenced  by  mission,  collection, 
and  exploitation  parameters,  including  film 
emulsion,  imagery  scale  and  target  aspect 
angle. 

(2)  To  formulate  specific  conclusions  and  recommenda¬ 
tions  for  color  photographic  technology  applications 
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to  strategic  and  tactical  aerial  reconnaissance 
operations , 


1 .  2  Scope  Of  The  Program 

To  accomplish  the  stated  objectives  a  three-part,  pro¬ 
gram  was  planned:  a  survey  of  imagery  and  information  applicable 
to  thv.  problems  of  color  photo  reconnaissance,  a  test  of  the  com¬ 
parative  values  of  panchromatic  and  color  aerial  photography 
under  the  stress  of  selected  independent  variable  factors,  and  an 
investigation  of  the  potential  of  color  inducement  techniques  in 
aerial  reconnaissance  imagery  interpretation. 

After  preliminary  investigation,  it  was  found  that  a 
meaningful  treatment  of  color  inducement  technology  was  beyond 
the  scope  of  this  contract,  and,  with  the  concurrence  of  the  Air 
Force  technical  monitors,  the  third  element  of  the  program  was 
discontinued . 

In  pursuing  the  proposed  imagery  survey  it  was  deter¬ 
mined,  after  considerable  effort,  that  the  amount  and  var. ety  of 
comparable  panchromatic  and  color  aerial  photography  available  to 
the  Air  Force,  which  was  to  provide  all  test  imagery  under  this 
contract,  would  not  support  the  proposed  test  effort.  The  test¬ 
ing  finally  conducted,  with  the  approval  of  technical  monitors, 
was  predicated  on  the  available  imagery,  and  differs  significantly 
from  that  originally  proposed.  However,  the  program  objectives 
were  satisfied  to  the  maximum  degree  allowed  by  the  available 
imagery.  The  measures  taken  to  circumvent  the  limitations  of  the 
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available  imagery,  the  shifts  in  program  emphasis  accepted  when 
necessary,  and  the  results  of  the  operations  undertaken  are  de¬ 
tailed  in  the  following  sections  of  the  report. 

2  •  IMAGERY  AND  INFORMATION  SURVEY 

2 . 1  Operat ions 

2.1.1  Literature  Search 

A  literature  search  was  made  to  insure  that  all  re¬ 
sources  were  thoroughly  investigated  and  that  proposed  tasks  had 
not  been  accomplished  in  the  work  of  others.  No  detailed  analy¬ 
sis  of  the  literature  was  undertaken,  nor  was  it  the  intent  of 
the  search  to  produce  a  bibliography  of  reconnaissance  color  de¬ 
velopment.  Defense  Documentation  Center  bibliographies  were 
reviewed  and  copies  of  significant  reports  were  ordered  for  study. 
In  addition,  the  Data  Base  at  RADC  was  searched  and  copies  were 
made  of  pertinent  data.  Of  particular  interest  throughout  the 
literature  search  were  the  film  catalogs  of  all  programs  for  which 
panchromatic  and  color  imagery  had  been  acquired.  Significant  pro¬ 
grams  were  noted  for  investigation  and  subsequent  imagery  search. 

A  trip  was  made  to  Eastman  Kodak  in  Rochester  to  dis¬ 
cuss  the  status  of  aerial  color  film  development  and  to  seek  ad¬ 
vice  on  devising  techniques  for  quality  control  of  color  imagery 
duplication. 

These  efforts  yielded  the  following  information. 

(a)  Few  studies  comparing  color  and  panchromatic 
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films  had  been  conducted  within  the  past  five 
years . 

(b)  Proposed  tests  would  not  duplicate  any  prior 
work . 

(c)  Present  technology  cannot  provide  quality 
controls  for  color  film  reproduction  which 
would  ensure  exact  rendition  of  tone  and  hue 
from  original  to  duplicate,  nor  can  differ¬ 
ences  between  them  be  effectively  quantified. 

2.1.2  Imagery  Search 

Since  no  imagery  acquisition  program  was  provided  in 
direct  support  of  the  proposed  tests,  it  was  necessary  to  use 
photography  already  acquired  on  other  programs.  Such  imagery  was 
scattered  at  the  film  libraries  of  several  government  agencies, 
and  the  extent  of  available,  usable  imagery  was  unknown.  In 
addition,  ground  truth  and  collateral  information  were  also  re¬ 
quired  to  piovide  control  of  proposed  test  parameters. 

» 

On  the  basis  of  the  literature  search,  the  programs 
listed  in  Table  I  were  selected  as  having  the  greatest  potential 
for  providing  imagery  appropriate  to  the  needs  of  the  Reconnais¬ 
sance  Color  Evaluation  testing  program.  In  addition,  U.3.  govern¬ 
ment  mapping  agencies  and  the  American  Society  of  Photogramme try 
in  the  Washington,  D.  C.,  area  were  selected  as  possible  sources 
of  photography. 


TABLE  I 


Programs  Investigated  as  Possible 
Sources  of*  Test  Imagery 


PROGRAM 

COGNIZANT  AGENCY 

Project  Tropican 

Rome  Air  Development  Center 
Research  and  Technology  Division 

Project  Art 

U.S.  Army  Electronics  Laboratorie 
U.S.  Army  Electronics  Command 

Project  Argos 

Inters^ ryice  Imagery  Acquisition 
Task  Group 

Project  Array 

Joint  Army/Air  Force  Imagery 
Acquisition  Task  Group 

Project  Arras 

Joint  Army/Air  Force  Imagery 
Acquisition  Task  Group 

Project  Road 

Joint  Army/Air  Force  Imagery 
Acquisition  Task  Group 

Project  Snowfex 

Joint  Army/Air  Force  Imagery 
Acquisition  Task  Group 

A  team  of  experienced  image  interpreters  visited  each 
facility  which  indicated  a  willingness  to  release  imagery  for 
test  purposes.  This  team  examined  at  each  library  all  film  which 
appeared  to  have  potential  for  the  testing  program.  In  all,  more 
than  10,000  feet  of  film  were  screened.  Rolls  selected  during 
the  initial  screening  were  shipped  to  the  contractor's  facility 
at  Rome,  New  York,  for  more  detailed  analysis  and  more  discrimi- 
nating  selection. 


To  meet  the  conditions  imposed  by  the  predetermined 
test  parameters  a  collection  condition  matrix  was  devised  to 
organize  the  collected  imagery  during  analysis  for  possible  use 
as  stimulus  material.  Initial  restrictions  imposed  on  imagery 
searchers  by  this  matrix  were  as  follows. 

(a)  Only  original  flight  records  would  be  col¬ 
lected  for  duplication. 

(b)  Panchromatic  and  color  would  be  concurrent 
and  congruent  in  regard  to  the  factors  con¬ 
sidered  in  the  matrix. 

(c)  Comparable  images  would  have  similar  formats, 
scales,  and  aspect  angles. 

The  matrix  called  for  sets  of  comparable  panchromatic 
and  color  imagery  showing  the  following  variations  deemed  to  be 
significant  j 
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Format 


-  Three  types 


Scale  -  Four  conditions 

Time  of  acquisition  *  Two  conditions 
Field  of  view  -  Two  conditions 

Target  site/density  -  Three  conditions. 

Thus,  144  sets  of  imagery  (or  a  minimum  of  288  frames)  were  re¬ 
quired  to  fill  each  matrix.  Coverage  of  six  categories  of  tacti¬ 
cal  targets  were  desired:  vehicles,  emplacements  personnel, 
animals,  shelters,  and  miscellaneous  targets. 

When  it  was  deteimined  that  panchromatic  and  color 
imagery  acquired  by  similar  systems  at  the  same  point  in  time  and 
space  was  not  readily  available  in  adequate  supply  an  alternate 
plan  was  considered.  To  save  substantial  travel  and  manpower 
expenditures,  and  to  provide  exact  duplication  of  test  image  spa¬ 
tial  relationships,  an  experiment  was  performed  duplicating  orig¬ 
inal  color  imagery  on  panchromatic  film  emulsions  to  provide  com- 
plementory  black  and  white  photos.  Appendix  1  describes  this 
experiment  which  demonstrated  that  black  and  white  tonal  values 
produced  in  the  laboratory  from  color  originals  could  not  be  made 
to  match  those  acquired  in  flight  on  panchromatic  films.  Since 
it  was  felt  that  valid  laboratory  simulations  could  not  be  pro¬ 
duced  without  considerable  development,  the  decision  was  made  to 
proceed  with  the  comprehensive  imagery  search. 

Reproduction  of  all  selected  imagery  mas  accomplished 
by  RADC.  Panchromatic  film  mas  reproduced  in  the  RADC 
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photographic  laboratory  and  color  film  was  reproduced  under  con* 
tract  by  another  contractor.  In  all  cases  precise  quality  control 
measures  were  called  for  to  insure  maximum  image  quality  of  dup¬ 
licate  images.  For  the  color  transparanc ies  '’maximum  quality'* 
was  designated  as  nearest  possible  duplication  :> f  density,  tone, 
and  hue. 

The  scheme  devised  for  the  collection  of  stimulus 
imagery  involved  four  steps  of  increasing  refinement: 

(a)  On-site  screening  at  film  libraries  for  gen¬ 
eral  quality,  and  general  congruity  of  color 
and  panchromatic  images. 

(b)  Initial  target  analysis  at  contractor's 
facility  to  select  appropriate  portions  for 
duplication. 

(c)  Quality  evaluation  and  detailed  target  and 
collection  condition  analysis  of  duplicated 
materials . , 

(d)  Selection  of  final  test  frames  and  construc¬ 
tion  of  scoring  overlays. 

Since  only  original  imagery  was  to  be  considered  for 
duplication,  it  was  necessary  to  screen  materials  at  their  repos¬ 
itories  because  holders  were  reluctant  to  release  large  quantities 
of  original  records .  Further,  in  several  cases  it  would  have  been 
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highly  impractical,  to  ship  the  total  coverage  acquired  for  a 
given  project. 

Limitations  posed  by  customer  resources  for  color  re¬ 
production  and  by  common- sense  economy  required  an  initial  analy¬ 
sis  of  all  rolls  of  film  sent  to  the  contractor  facility  to  elim¬ 
inate  needless  reproduction  of  materials.  On  the  other  hand, 
custodians  of  the  original  imagery  would  release  film  only  for  a 
period  of  30  deys  or  less.  Since  color  reproduction  was  performed 
by  another  contractor  at  another  location,  the  bulk  of  this  period 
was  needed  for  duplication.  In  no  case  was  color  film  reproduced 
and  returned  for  quality  comparison  with  originals  in  less  than 
20  days.  It  was  impossible,  therefore,  to  perform  a  detailed 
target  analysis  prior  to  reproduction. 

Immediately  upon  ths  return  of  duplicated  materials  a 
subjective  quality  evaluation  was  made  of  all  duplicate  color 
transparancies  by  comparing  them  frame-by-frame  with  the  original 
records.  Hue  and  tonal  values  were  carefully  matched  against  the 
original  film  for  accuracy  of  duplication.  Brief  descriptive 
evaluations  were  prepared  for  all  duplicated  color  materials 
prior  to  returning  the  original  film  to  its  custodian. 

Detailed  image  analysis  of  all  duplicated  materials 
completed  the  third  step  in  test  image  selection.  Targets  or 
target  equivalents  were  annotated  and  enumerated,  rough  overlays 
were  made,  and  notes  were  recorded  on  potential  testing  tasks  for 
each  portion  of  imagery.  Selected  imagery  was  classified  and 
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assigned  a  position  in  predetermined  collection  condition  ma¬ 
trix, 


The  final  step  was  the  selection  of  frames  to  be  used 
as  test  materials  and  the  designation  within  those  frames  of 
target  stimuli  for  which  interpreter  responses  would  be  measured. 
The  chosen  frames  were  then  arranged  info  numbered  test  packets 
and  scoring  aids  such  as  overlays  and  grids  were  constructed  as 
appropriate . 


2 . 2  Results  Of  The  Imagery  Search 

The  net  result  of  the  operations  described  above  was  to 
make  it  clear  before  the  final  step  described  above  that  the 
volume  and  variety  of  appropriate  aerial  imagery  available  to  the 
Air  Force  was  not  sufficient  to  allow  completion  of  testing  in 
the  form  originally  proposed.  As  the  imagery  search  progressed, 
it  became  evident  that  most  of  the  imagery  of  acceptable  quality 
fell  within  a  very  few  blocks  of  the  collection  condition  ma¬ 
trices.  For  example,  significant  differences  in  times  of  day, 

aspect  angle,  and  field  of  view  were  not  found  in  abundance,  if 

* 

at  all.  For  in  the  category  of  vehicles,  which  were  the  most 
commonly  imaged  target  type,  only  20  of  the  144  matrix  addresses 
were  filled  by  the  end  of  the  photo  search  phase.  Other  target 
matrices  had  as  few  as  six  entries, 


Specifically,  the  imagery  was  deficient  in  four  ways: 


(1)  Very  little  concurrently-collected  panchromatic 
and  color  photography  existed.  Also,  upon 

i 
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exam  Uat  ion ,  very  little  of  the  apparently  com¬ 
parable  panchromatic  and  color  imagery  was,  in 
fact,  congruent  or  nearly  so  with  respect  to  the 
selected  tes^  parameters  (format,  target  aspect 
angle,  target  -  to -bac kground  relationship,  target 
image  density  and  size,  and  time  of  collection). 

(2)  Coverage  of  a  sufficient  variety  of  tactical  and 
strategic  military  targets  was  lacking. 

(3)  Comparable  coverage  of  actual  military  targets 
was  not  varied  enough  with  regard  to  the  selected 
parameters  to  fill  the  matrix  and  allow  testing 
of  the  effect  of  change  in  particular  factors. 
Variation  which  did  occur  was  not  systematic. 

(4)  Documentation  of  ground  situations  represented  in 
the  available  coverage  was  lacking  in  most  cases. 

In  response  to  the  basic  shortage  of  appropriate  test 

photography,  the  approach  to  test  design  was  reversed.  Rather 

* 

than  continuing  to  search  for  photography  to  fill  the  predeter¬ 
mined  testing  matrix,  it  was  decided  to  evaluate  the  available 
comparable  coverage  and  build  a  test  based  on  its  contents. 

To  deal  with  the  particular  imagery  deficiencies  out¬ 
lined  above  a  number  of  specific  changes  Were  made. 

(1)  As  an  alternative  to  concurrently  collected  pan¬ 
chromatic  and  color  imagery  (which  would  be 
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comparable  in  all  respects),  a  very  rudimentary, 
but  operationally  realistic,  comparability  was 
substituted.  Considerations  of  film  emulsion, 
aspect  angle  and  time  of  collection  were  dropped, 
because  significant  variations  in  these  areas  were 
almost  totally  lacking  in  the  available  Imagery. 
Stress  was  laid  on  similarity  of  coverage  and  com* 
parable  relationships  between  format  and  the  size 
and  density  of  target  images  in  both  color  and 
black-and-white  photography.  In  several  cases 
where  only  desirable  color  imagery  existed,  efforts 
were  made  to  have  comparable  coverage  collected  on 
a  no -cost  basis. 

(2)  To  overcome  the  lack  of  military  target  coverage, 
equivalent  non-military  targets  were  searched  out. 
The  judgment  of  equivalency  was  based  on  frequency 
of  occurrence,  image  size  and  density  in  relation 
to  format,  and  target- to-background  relationships. 

A  consensus  in  regard  to  equivalency  was  required 
among  the  experienced  interpreters  constructing 
the  test. 

(3)  Because  a  classic  test  of  the  influence  of  pre¬ 
determined  independent  variables  was  clearly  im¬ 
possible,  the  focus  of  the  test  was  shifted,  k  It 
was  decided  to  emphasize  a  variety  of  interpretation 
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tusks  rather  than  variations  in  imagery  character¬ 
istics,  Imagery  on  hand  was  found  to  be  suffi¬ 
cient,  for  this  purpose. 

(4)  Because  of  the  lack  of  ground  information  on  se¬ 
lected  military  and  non-military  targets,  multiple 
analysis  of  test  imagery  leading  to  a  consensus 
interpretation  was  carried  out.  Each  piece  of 
potential  test  imagery  was  analyzed  by  at  least 
three  interpreters.  Only  imagery  on  which  a  con¬ 
sensus  interpretation  could  be  produced  was  in¬ 
cluded  in  the  test. 

3y  these  measures  there  was  constructed  a  test  deemed, 
under  the  circumstances,  to  be  extensive  and  incisive  in  its 
coverage  of  color  reconnaissance  problems. 

3*  TEST  DESIGN  AND  ADMINISTRATION 

The  types  of  problems  presented  to  interpreters  in  this 
test  program  were  determined  by  three  considerations: 

(1)  The  basic  tasks  which  make  up  the  analytical  work 
of  an  operational  interpreter. 

(2)  The  characteristics  of  color  imagery  which  differ¬ 
entiate  it  from  panchromatic  imagery  and  which 
would  give  rise  to  any  advantages  or  drawbacks  in 
its  use  instead  of  panchromatic  imagery. 


(3)  The  content  and  characteristics  of  the  available 
imagery. 

3 . 1  Operational  Considerations 

The  tasks  which  are  the  components  of  any  specific 
photo-analytic  assignment  were  defined  for  purposes  of  this  test 
as  the  following: 

(1)  Searching  for  and  counting  recognizable  target 
signatures . 

(2)  Analyzing  complex  images  and  discriminating  be¬ 
tween  like  signatures  vy  observation,  comparison, 
and  mensuration. 

(3)  Delineating  boundaries  not  clearly  defined  by  the 
characteristic  signature  of  the  target. 

(4)  Plotting  items  found  in  imagery  on  another  graphic 
representation  of  the  same  geographic  site. 

It  was  recognized  that  these  tasks  are  rarely  performed, 

* 

operationally  in  isolation  from  one  another,  but  the  effort  was 
made  to  devise  realistic  test  problems  which  would  highlight 
each  of  the  tasks  and  perhaps  illuminate  the  effect  of  the  use  of 
color  imagery  on  its  performance. 

3.2  Technical  Considerations 

The  characteristic  of  color  photography  which  is  most 
apparent  to  the  analyst  is,  of  course,  the  color  emulsion/ .\ 
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ability  to  record  target  hue  as  well  as  value  with  some  degree  of 
accuracy.  A  second  is  the  relatively  coarser  grain  structure  of 
color  emulsions  vis-a-vis  panchromatic  emulsions  normally  used 
in  aerial  reconnaissance  and  the  lower  spatial  resolution,  asso¬ 
ciated  with  it.  A  third  characteristic,  relatively  less  apparent 
to  the  analyst,  but  nevertheless  important  in  certain  reconnais¬ 
sance  situations,  is  the  relatively  higher  illumination  require¬ 
ments  of  color  emulsions  as  compared  to  black-and-white  emulsions 
which  restrict  the  light  conditions  under  which  acceptable  color 
imagery  can  be  collected.  It  was  felt  that,  from  the  analyst’s 
point  of  view,  the  advantages  or  disadvantages  accruing  to  the 
use  of  color  photography  would  probably  be  traceable  to  these 
characteristics.  Attempts  were  r.ade  in  designing  the  test  to 
find  situations  wherein  these  characteristics  would  play  an  im¬ 
portant  part. 

3 . 3  Imagery  Considerations 

Consideration  of  the  characteristics  of  the  available 
imagery  unfortunately  served  to  limit  somewhat  the  treatment  in 
this  test  of  both  analytical  tasks  and  distinctive  characteris¬ 
tics  of  color  films.  Lock  of  long  continuous  samples  of  compara¬ 
tive  color  and  panchromatic  imagery  precluded  problems  involving 
the  rapid  scanning  and  plotting  work  characteristic  of  immediate 
post -collect ion  operational  interprefat ion.  All  problems  in¬ 
volved  finally,  relatively  detailed  analysis  of  small  amounts  of 
film.  It  was  found  also  tbit  there  were  no  acceptable  samples 


of  film  collected  at  other  than  optimum  times  of  day.  This  pre¬ 
cluded  testing  of  the  effects  of  marginal  target  illumination. 

On  the  positive  side,  the  available  imagery  included  a  useful 
variety  of  target  backgrounds.  Though  hoped-for  records  of  sea¬ 
sonal  changes  over  like  sites  were  not  found,  the  collection  was 
sufficient  to  provide  test  imagery  with  a  wide  variety  of  natural 
and  cultural  settings,  Sets  of  test  imagery  showing  tactical 
military  targets  were  in  short  supply,  but  non-military  "targets" 
did  appear  which  allowed  formulation  of  problems  judged  to  be 
equivalent  to  those  of  the  operational  analyst  working  with  mili¬ 
tary  targets.  In  addition,  strategic  targets  were  represented 
in  adequate  number  and  variety  in  the  available  imagery  to  allow 
some  freedom  of  selection. 

3 . 4  Test  Problems  and  Tasks 

It  proved  possible  to  derive  from  the  various  combina¬ 
tions  of  backgrounds  and  actual  or  constructive  targets  a  test 
consisting  of  eight  problems,  each  represented  by  two  typical 
tasks.  The  doubling  of  each  type  of  problem  served  to  provide 
some  check  of  the  quality  and  validity  of  individual  casks,  as 
well  as  to  enlarge  the  base  from  which  test  data  were  derived 
and  to  make  a  varied  and  interesting  test.  For  each  task  there 
was  available  comparable  panchromatic  and  color  photography  suf¬ 
ficient  for  stereo  as  well  as  monocular  analysis.  All  problems 

|  , 

and  tasks  were  examined  carefully  in  a  pre-test  by  two  experi¬ 
enced  interpreters.  Revisions  in  the  matter,  scope  and  time 


limits  were  made  as  recommended  by  these  analysts.  The  tasks  and 
the  characteristics  of  the  photo  coverage  for  each  one  are  given 
in  detail  in  later  sections  of  this  report  dealing  with  the  spe¬ 
cific  problems  and  the  test  results  for  each. 

3 . 5  Testing  Environment 

Bach  test  subject  was  given  the  test  in  isolation.  He 
was  attended  by  a  test  monitor  whose  job  it  was  to  present  and 
explain  tasks  in  random  sequence,  record  subject  responses  to 
each,  and  keep  time.  This  arrangement  served  to  standardize  both 
administration  and  data  collection,  to  allow  the  subject  closer 
concentration  on  the  test  imagery,  and  to  shorten  overall  test 
administration  time.  Subjects  viewed  all  test  imagery  in  posi¬ 
tive  transparent  form  on  horizontal  light  tables.  Viewing  de¬ 
vices  used  were  standard  2X  and  4X  folding  stereoscopes  and  7X 
tube  magnifiers.  Measurement  was  done  with  .001*  scales  and 
reticles. 


7.6  Test  Administration 

The  test  was  administered  to  twenty -four  subjects,  all 

* 

imagery  analysts  employed  by  Autometric/Raytheon  Company.  Before 
beginning  the  test  each  subject  filled  out  the  subject  biography 
sheet  included  in  Appendix  A.  General  Instructions  for  the  test 
were  given,  along  with  a  preliminary  problem  to  familiarize  the 
subject  with  testing  and  recording  procedures*  The  sixteen  tasks 
of  the  test  proper  were  then  presented  in  carefully  randomized 
order.  Type  of  film  (color /panchromatic)  to  be  viewed  in  each 
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problem  and  mode  of  viewing  (monocular/stereoscopic)  were  also 
pre-determlned  to  guarantee  an  even  distribution  of  film  type  and 
viewing  mode  for  each  subject  and  problem.  If,  for  instance,  the 
first  task  of  a  given  problem  was  presented  to  a  subject  for  mo¬ 
nocular  analysis  using  color  film.,  the  same  subject  would  later 
be  presented  with  the  second  task  for  that  problem  and  asked  to 
perform  stereoscopic  analysis  using  pancnromat ic  photography. 

Each  problem  situation  was  presented  according  to  the  scri  pt  in¬ 
cluded  in  Appendix  A.  A  standard  time  limit  for  each  problem  was 
stated.  These  limits  were  pre-determined  to  be  moderately  gener¬ 
ous,  and  were  used  to  make  subjects  aware  that  time  was  a  test 
factor,  rather  than  to  limit  working  time.  Subjects  were  asked 
not  to  guess  at  responses,  but  to  decline  to  make  a  response  if 
they  felt  image  quality  would  not  allow  accurate  analysis.  By 
design,  all  subject  responses  were  made  verbally  to  the  test 
monitor,  who  recorded  the  data  on  the  prepared  form,  which  is 
included  in  Appendix  A.  Data  recorded  included  order  of  task 
presentation,  film  type/viewing  mode,  subject  responses,  elapsed 
time  for  whole  problems  and  significant  segments,  and  confidence 
in  response  accuracy  and/or  completeness  stated  as  one  of  seven 
levels  ranging  from  complete  lack  of  confidence  to  certainty. 
(Seven  levels  were  proposed  in  order,  hopefully,  to  avoid  easy 
quantizing  of  the  response  and  possible  bunching  of  responses 
around  common  numerical  values.) 
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Following  the  completion  of  all  testing,,  the  responses 
of  each  interpreter  were  scored.  Raw  scores  and  scores  adjusted 
for  time  consumption  were  calculated  for  each  task.  In  addition, 
types  of  errors  -  *  commission,  omission  or  failure  to  respond  -  - 
were  differentiated.  All  these  data,  together  with  the  raw  test 
responses,  were  recorded  on  test  score  sheets  of  the  type  in¬ 
cluded  in  Appendix  A  and  passed  to  American  Institutes  for 
Research  for  thorough  analysis  under  subcontract  to  Autometric/ 
Raytheon  Company. 

4.  TEST  DATA  ANALYSIS 

4 . 1  Experimental  Design 

Separate  analyses  were  desired  for  each  of  eight  types 
of  reconnaissance  problems.  Corresponding  panchromatic  and  color 
imagery  were  assembled  for  two  different,  but  reasonably  equiva¬ 
lent,  tasks  per  problem.  This  assortment  of  imagery  permitted 
the  use  of  a  balanced  incomplete  blocks  experimental  design1, 
with  two  two- level  factors:  Color  (panchromatic  vs.  color  imagery) 
and  Viewing  Mode  (mono  vs.  stereo). 

Bach  of  twenty-four  subjects  performed  the  prescribed 
interpretations  for  all  sixteen  tasks,  having  been  assigned  ran¬ 
domly,  for  each  task,  one  of  the  four  possible  combinations  of 
pan-color  and  mono-stereo,  wi  .in  the  following  constraints: 


Brownlee,  K.A. ,  Industrial  Bxqor lamentation,  4th  American 
Edition.  Brooklyn : Chemical  Publishing  Co. ,  19 $3. 


©ach  level  of  both  factors  was  employed  once  only  par  subject  for 
the  two  tasks  representing  one  of  the  eight  problems;  and  across 
all  subjects,  each  task  was  assigned  equal  numbers  of  the  four 
fact  or -level  combinations.  As  a  result,  for  each  of  the  eight 
problems  a  subject  was  observed  under  both  levels  of  Color  and  of 
Viewing  Mode,  but  under  only  two  of  the  four  possible  factor- 
level  combinations.  In  addition,  the  sixteen  tasks  were  presented 
to  each  subject  in  a  unique  random  order. 

The  design  which  was  employed  permits  the  statistical 
evaluation  of  the  effects  of  Color  and  of  Viewing  Mode  upon  the 
obtained  scores,  by  means  of  the  Analysis  of  Variance  technique. 
This  evaluation  is  reliable  at  the  test  and  problem  levels,  but 
not  for  individual  tasks.  Because  of  the  presence  of  incomplete 
blocks  in  the  design,  the  effects  of  the  interactions  of  Color 
and  Viewing  Mode  cannot  be  evaluated.  (The  use  of  four  equivalent 
target  tasks  per  problem  would  have  permitted  a  complete-block 
design  with  resulting  evaluation  of  these  interactions,  but  the 
amount  and  variety  of  available  imagery  precluded  this  approach.) 

It  should  also  be  noted  that,  in  the  Analysis  of  Vari¬ 
ance  for  the  balanced  incomplete  blocks  design,  the  effect  of 
factor  interactions  upon  the  data  --  to  the  extent  that  they 
exist  *-  is  to  provide  an  overestimate  of  '’error”  variance.  This, 
in  turn,  increases  the  conservatism  of  the  statistical  tests  of 
main  factor  effects  beyond  that  which  is  intended  i.e. , 
decreases  tne  chances  of  obtaining  statistically  significant 
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findings  for  an  actual  factor  effect.  However ,  in  the  experi¬ 
ment,  there  is  no  prior  evidence  to  suggest  strong  interactions 
of  Color  and  Viewing  Mode  upon  interpreter  performance,  and  thus 
it  was  expected  that  the  most  detrimental  effect  of  the  short¬ 
coming  in  the  design  would  be  to  mask  out  the  weaker  Color  or 
Viewing  Mode  effects  which,  although  statistically  significant, 
would  represent  low  magnitude  differences  in  performance  scores, 

4 . 2  Performance  Scoring  and  Analysis 

Five  methods  of  scoring  reconnaissance  performance 
were  employed  in  this  study.  The  scores  were  calculated  separ¬ 
ately  for  each  of  the  sixteen  tasks. 

Terms  employed  in  the  scoring  formulae  were  defined  as 

follows: 


cpr  *  mutt  er  of  correct  possible  responses  for  a 
problem 

errors  *  number  of  targets  miised  in  search  problems 
(errors  of  omission);  number  of  misidentifi- 
cations  and'  non-responses  in  analysis  prob¬ 
lems 

fa  *  "false  alarms"  --  nuvber  of  mis  identifications 
in  search  problems 

et  -  elapsed  time  for  subject  performance 
2McNemar,  Q.,  Psychological  Statistics,  Second  Bdition,  New 


at  *  maximum  allowed  time  for  performance  on  a 
target  area, 

The  scores  were: 

Raw  Score  0  100  X  _ " . f.a 

cpr 

Adjusted  Score  =»  Raw  Score  +  100  -  (100  X  Si.) 

at 

Accuracy  Score  » 

100  X  number  of  correct  responses  made 
tot al  number  of  responses  made 

Completeness  Score  = 

100  X  number  of  correct  responses  made 

cpr 

Speed  Score  -  100  -  (100  X  -  100  (1  -  «£) 

at  at 

Subjects  were  required  to  express  their  confidence  in 
their  responses  on  a  seven-point  scale  ranging  from  A  (none, 
guess)  through  G  (certain).  For  the  data  analysis,  these  scores 
were  converted  to  equal -interval  weights  of  values  zero  through 
one.  The  weights  were  applied  to  the  basic  raw,  adjusted  (raw 
component),  accuracy  and  completeness  scores,  to  obtain  a  parallel 
set  of  confidence-weighted  acores.  The  use  of  confidence  weights 
was  an  effort  to  compensate  for  the  unavoidable  artificia’ 5 '  v  of 
the  experimental  situation,  in  which  subjects  can  be  expec^d  to 
report  more  low-confidence  material  than  in  many  operational  sit¬ 
uations. 
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SUMMARY  OF  TESTING  AND  ANALYSIS 

In  the  following  pages  the  test  and  the  test  data  are 
analyzed  in  detail.  The  first  sections  of  this  analysis  include 
general  Information  on  the  test  and  its  findings.  The  succeeding 
sections  each  cover  one  of  the  eight  problems  of  the  test  and  the 
two  tasks  presented  to  subjects  as  typical  of  that  problem.  In 
each  the  problem  and  tasks  are  described  and  the  findings  listed. 
Then  the  reliability  of  the  tasks,  the  validity  of  the  collected 
data  and  the  implications  of  the  results  are  discussed.  Each 
section  also  contains  graphic  representations  of  the  findings 
developed  from  the  figures  included  in  Appendix  B,  Test  Analysis 
Data . 

5 . 1  General  Informat ion 

Of  the  eight  problems  included  in  the  test,  the  first 
four  center  on  aspects  of  searching,  and  the  last  four  on  analy¬ 
sis.  The  final  problem  is  one  of  target  delineation,  here  con¬ 
sidered  as  n  special  case  of  analysis.  The  search  problems  were 
designed  to  focus  on  completeness,  minimizing  analytical  work 
and  questions  of  accuracy.  Imagery  scales  and  target  signatures 
selected  were  such  as  to  reduce  target  identification  errors  to 
the  minimum.  Therefore,  accuracy  was  assumed,  and  only  those 
targets  reported  in  excess  of  the  number  known  to  be  present  were 
scored  as  errors  of  commission,  or  "false  alarms".  The  reverse 
was  true  of  the  analysis  problems.  Problems  of  completeness  were 
minimized,  and  questions  of  accuracy  underscored.  Targets  were 
annotated  and  desired  responses  specifically  requested  in  most 


cases  ,  so  differences  between  accuracy  and  couple  ter  ess  In,  the 
analytical  problems  (4  through  8)  are  Indications  of  refusals  to 
respond  on  the  part  of  subjects  who  considered  the  imagery  in¬ 
adequate  for  the  particular  task. 

5 . 2  General  Findings 

Across  the  test  as  a  whole,  interpretation  of  color 
imagery  was  found  to  be  significantly  faster,  statistically,  than 
interpretation  of  panchromatic  films.  No  statistically  signifi¬ 
cant  diffei ences  between  color  and  panchromatic  interpretation 
were  found  in  regard  to  accuracy  and  completeness,  though  minor 
differences  in  completeness,  in  fa’for  of  color,  were  recorded 
(see  Figure  1). 

Again  considering  the  test  as  a  whole,  no  significant 
differences  in  any  aspect  of  performance  were  found  between  mo¬ 
nocular  and  stereoscopic  interpretation. 

It  is  also  worth  noting  that,  overall,  weighting  of 
scores  for  subject  confidence  in  performance  brought  about  no 
significant  shifts  in  relationships  between  the  types  of  inter¬ 
pretation  compared  (see  Figure  2  and  Table  II), 
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SUMMARY  OF  SIGNIFICANT  DIFFERENCES 
TABLE  II 

VIEWING  MODE  EFFECTS 


Piob. 

Score 

Mono 

Mean 

Stereo 

Mean 

Diff  ■ 

F  Ratio 

df 

£ 

5 

Adjusted  - 
Bas  ic 

95.44 

81.01 

14.43 

4.278  2 

1,45 

< .  0  s 

• 

COLOR  EFFECTS 

Prob . 

Score 

Color 

Mean 

Pan 

Mean 

Diff. 

F  Ratio 

df 

£ 

Overall 

1  thru  8 

Speed  - 
Basic  11  * 

37.51 

32.69 

4.82 

4.342  8 

1,381 

<.05 

3 

Adjusted  - 
Basic 

127.37 

107.67 

19.70 

5.0492 

1,45 

<.05 

Conf.  Wtd. 

104.66 

83.85 

20.81 

5.1509 

1,45 

<.05 

3 

Comp .  - 
Basic 

82.62 

72.57 

10.05 

4.0316 

1,45 

* 

Conf.  Wtd. 

59.74 

48.33 

11.41 

4.1282 

1,15 

<r.0S 

5 

Adjusted  - 
Mean 

108.33 

92.82 

15.53 

6.5542 

1,45 

<.05 

Conf.  Wtd. 

96.47 

79.98 

'  * 

16,49 

5.5880 

1,45 

<.05 

5 

Speed  - 
Basic  ** 

38.43 

28.58 

9.85 

S. 3507 

1,45 

<.05 

*  F  ratio  fails  to  attain  .05  significance  by  0.03 


**  Confidence  weights  not  applied  to  speed  scores 
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Problem  1.  Search:  High  Target  Density/Urban  Back  * 
Ground 

This  problem  was  one  of  finding  many  targets  of  one 
type  against  an  urban/suburban  background  and  counting  them 
accurately.  It  focused  on  the  influence  of  film  type  and  mode 
of  analysis  on  the  orderliness,,  completeness  and  speed  of  the 
search  operation.  The  analyt’  1  aspects  of  the  problem  were 
reduced  to  a  minimum  by  directing  the  search  toward  a  single, 
easily-recognized  target  type  which  appeared  many  times  in  the 
imagery  at  a  scale  moderate  in  relation  to  target  size.  The 
background  was  characterized  by  the  broken  geometric  patterns  of 
line,  tone  and  texture  typical  of  culturally  developed  areas. 

5 .  3 , 1.  Task  1 

The  subjects  were  asked  to  find  and  count  all  the  hard- 
surfaced  multiple-vehicle  parking  lots  imaged  in  vertical  cover¬ 
age  of  Annapolis,  Maryland  at  a  scale  of  1/20,000.  Seven  9" 
frames  of  either  panchromatic  or  color  imagery  were  presented. 
Both  films  covered  the  same  targets  on  nearly  congruent  flight 
lines,  so  coverage  was  comparative,  except  for  mild  seasonal 
changes  which  were  judged  to  be  insignificant  to  test  target 
interpretation.  Twenty-five  targets  were  imaged,  and  the  subject 
was  asked  to  report  each  ten  as  counted  and  a  final  total  within 
20  minutes,  Target  counts  and  reporting  times  were  recorded 
along  with  the  subject's  confidence  in  the  completeness  of  his 
final  count. 
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5,3.2 


Task  2 


The  subjects  were  asked  to  count  self-propelled  vessels 
larger  than  tugs  shown  in  verticle  coverage  of  the  harbor  of 
Bayonne ,  New  Jersey  at  a  scale  of  1/165,000.  Three  70mm  frames 
of  either  panchromatic  or  color  imagery  were  examined  by  the  sub¬ 
jects,  but  the  test  area  was  that  covered  by  the  center  frame 
only.  The  samples  were  collected  concurrently.  Forty-six  tar¬ 
gets  were  imaged.  The  subject  was  asked  to  count  them  in  groups 
of  ten  and  report  a  final  count  and  his  confidence  in  its  com¬ 
pleteness  within  10  minutes. 

5.3.3  Findings 

At  the  problem  level,  no  statistically  meaningful  dif¬ 
ferences  in  performance  were  found  in  comparing  basic  mean  scores 
of  pan  and  color  or  mono  and  stereo  interpretations  (see  Figure 
3).  Confidence -weighted  mean  scores  paralleled  basic  means  very 
closely  (see  Figure  4).  No  reversals  occurred. 

5.3.4  Discussion 

Though  the  test  data  is  not  reliable  below  the  problem 

*  f 

level,  it  should  be  noted  that  ninor  reversals  between  color  and 
pan  analyses  were  recorded  in  the  results  of  Tasks  1  and  2.  One 
cause  of  this  may  have  been  the  poorer  quality  (graininess)  of 
the  smaller  scale  Task  2  color  imagery  as  compared  to  the  Task  1 
imagery.  HoweveT ,  the  validity  of  neither  task  seemed  tp  be 
harmed.  Very  high  mean  accuracy  scores  at  the  task  and  problem 
levels  and  the  closeness  of  mean  raw  and  completeness/scores 


indicate  that  the  task®  functioned  as  designed.  Confidence 
seemed  to  reflect  actual  performance  fairly  accurately  in  both 
tasks  . 

It  may  be  speculated  that,  because  the  urban  background 
of  the  imagery  in  this  problem  was  broken  in  pattern,  color  clues 
offered  nothing  useful  to  the  analyst  or  perhaps  operated  as  a 
mild  confusion  factor  in  his  attempts  to  separate  targets  from 
background. 
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S 4 4  Problem  Search:  Lem  Target  Density/Urban  Buck- 

ground 

The  primary  work  in  this  problem  was  finding  rare  or 
isolated  targets  in  ari  urban/suburban  environment*  The  targets 
were  easily  recognized  and  well -imaged  so  that  difficulty  of 
identification  was  minimized.  The  object  was  to  measure  the 
thoroughness  and  speed  of  the  search  made  using  each  of  the  test 
films . 

5.4.1  Task  3 

The  subjects  were  asked  to  find  and  count  seven  dif¬ 
ferent  target  types  in  the  area  of  Annapolis,  Maryland.  The 
imagery  consisted  of  fourteen  9"  vertical  panchromatic  frames  or 
ten  9"  vertical  color  frames,  both  strips  at  a  scale  of  1/40,000. 
Flight  lines  were  near-congruent,  so  the  imagery  was  comparable 
except  for  minor  seasonal  variations.  A  total  of  eight  targets 
were  imaged  in  six  of  the  seven  categories  requested,  the  one 
category  not  represented  having  been  added  as  a  confusion  factor. 
The  categories  included  Mike  sites,  underground  storage  areas, 
and  dry  docks  among  other  targets  of  like  size.  A  simple  recog¬ 
nition  key  was  distributed  which  showed  salient  features  of  the 
requested  targets.  Target  counts  in  all  categories  were  recorded 
along  with  completeness  confidence,  wA  *0  minutes  were  allowed 
for  completion, 
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minutes  all  road,  street  and  highway  construction  sites  shown  in 
vertical  coverage  of  a  suburban  area  of  San  Francisco  at  1/40,000 
scale.  Twelve  frames  of  concurrently  exposed  70mm  panchromatic 
or  color  film  made  up  the  test  sample,  Eight  targets  were  imaged 
Test  monitors  recorded  each  subject's  total  count,  elapsed  time 
and  confidence  of  completeness. 

S » .4 , 3  Findings 

Mean  scores  at  the  problem  level  showed  very  similar 
results  for  pan  and  color  analysis  and  mono  and  stereo  viewing 
of  the  problem  imagery  (see  Figure  5),  No  statistically  signi¬ 
ficant  variations  occurred-  The  very  minor  differences  which 
were  recorded  were  further  dampened  when  scores  were  weighted 
for  confidence  (see  Figure  6) . 

5.4.4  Discussion 

As  in  Problem  1,  it  may  be  that  the  broken  urban  back¬ 
ground  reduced  the  significance  of  color  in  finding  targets  with¬ 
out  unique  color  signatures. 

The  relationships  her ween  means  for  the  variables  with¬ 
in  each  task  were'  closely  parallel  to  those  for  the  problem  ovor - 
all,  indicating  that  the  individual  tasks  wore  reliable.  However, 
subjects  did  noticeably  less  well  on  all  aspects  of  Task  J  than 
Task  4 »  regardless  of  film  type  or  mode  of  analysis,  Likewise, 
confidence  in  completeness  was  lower  across  all  variables  for 
Ta»h  3  than  Task  4,  though  unnecessarily  so.  This  lower  perfor¬ 
mance  and  even  lower  confidence  may  be  attributable  to  the  fact 


that  Task  3  involved  several  types  of  targets  while  Task  4  in 
volvcd  only  one.  Task  3,  therefore,  may  have  demanded  more 
skill  and  background  than  Task  4,  or  may  have  caused  some  con 
fusion  by  its  relative  complexity. 
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5 . S  Problem  3.  Search:  High  Target  Denstty/Rura)  Rack" 

Ground 

This  problem  was  parallel  to  the  first  search  problem 
( 5 . T  above)  in  that  it  involved  finding  and  counting  many  targets 
of  an  easily  "identified,  type.  Again  the  primary  objective  was  to 
test  the  orderliness,  completeness  and  speed  of  the  search  per¬ 
formed,  However,  the  background  in  this  case  was  rural,  charac¬ 
terized  by  the  more  organic  patterns  of  line,  tone  and  texture 
typical  of  relatively  undisturbed  natural  topography  and  ground 
cover . 

S .  5  .  i.  Task  5 

The  assigned  task  was  to  detect  and  count  all  sampans 
imaged  in  forty-eight  frames  of  7lmm  vertical  photography  cover¬ 
ing  a  canal  village  In  Southeast  As; :1a.  The  panchromatic  and  color 

imagery  was  flown  concurrently  at  a  scale  of  1/2,500.  Fift^-four 
sampans  were  imaged.  Subjects  were  asked  to  report  targets  in 
groups  of  ten,  a  fina’  count  and  confidence  in  its  completeness. 
Twenty -five  minutes  were  allowed  for  the  search.  Monitors  also 
recorded  elapsed  time  at  each  report  of  ten  targets  and  at  the 
final  report.  Because  of  the  large  photo  scale  and  the  simpli¬ 
city  of  the  target,  it  was  assumed  that  the  number  of  false  tar¬ 
gets  reported  would  be  insignificant. 

5.5.2  Task  6 

Subjects  were  asked  to  detect  and  count  within  IS  min¬ 
utes  all  transmissi  n  line  towers  imaged  in  coverage  of  a  rural 
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aret.  near  San  Francisco.  One  hundred  and  nine  targets  were  in¬ 
cluded  in  the  test  imagery,  Both  panchromatic  and  color  imagery 
samples  consisted  of  twelve  frames  of  70mm  vertical  photography 
collected  concurrently  at  a  scale  of  1/40,000,  Again,  targets 
were  reported  in  groups  of  ten,  and  the  task  was  completed  with 
a  final  count  and  a  statement  of  confidence  in  its  completeness. 
Elapsed  time  was  recorded  at  each  report.  Because  of  the  unique 
character  of  the  target  and  the  rural  background  of  the  imagery, 
it  was  assumed  that  only  an  insignificant  number  of  false  targets 
would  be  reporter, 

5.5.3  Findings 

Both  basic  and  confidence-w^ight^d  mean  adjusted  scores 
indicated  a  statistically  significant  difference  in  favor  of 
color  film  analysis.  The  mean  adjusted  score  for  color  analysis 
bettered  that  for  pan  analysis  by  approximately  251.  Basic  mean 
scores  for  completeness  showed  a  near-significant  advantage  for 
color  analysis  which  became  significant  when  weighted  for  confi¬ 
dence.  Minor  advantages  for  color  analysis  were  also  recorded 
in  basic  and  confidence-weighted  mean  raw  and  speed  scores.  Mean 
scores  for  mono  and  stereo  analysis  showed  very  little  difference, 

5.5.4  Discussion 

The  advantage  indicated  for  color  analysis  may  be  due 
to  the  fact  that  targets  in  this  problem  were  imaged  against 
natural  background  which  was  relatively  homogeneous  in  comparison 
to  the  background  in  Problems  1  and  2.  In  this  context,  color 
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clues  might  be  expected  to  be  more  distinguishing.  It  Is  inter¬ 
esting  to  note  that  the  advantages  for  color  film  shown  at  the 
problem  level  were  carried  through  both  tasks,  and  were  magnified 
in  Task  6  where  the  background  characteristics  were  most  uniform. 
See  Figures  7  and  8. 
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ground 

As  in  the  second  search  problem  (S.4  above),  the  sub¬ 
ject  was  to  find  rare  and/or  isolated  targets.  In  this  case, 
however,  the  background  was  rural  and  primarily  natural,  rather 
than  urban  and  cultural.  Selected  targets  were  easily  identifi¬ 
able  and  well - imaged ,  so  that  success  depended  primarily  on 
thoroughness  and  speed,  rather  than  analytical  skill. 

5.6.1  Task  7 

Subjects  were  given  ten  minutes  to  detect  and  count  all 
military  vehicles  shown  in  test  imagery  covering  a  lightly  wooded 
maneuver  area  at  Camp  Drum,  New  York,  during  a  late  winter  armor¬ 
ed  exercise.  Panchromatic  imagery  consisted  of  four  9"  vertical 
frames  at  a  scale  of  1/1,000  on  which  an  area  of  interest  (a  plot 
of  color  photo  coverage)  was  outlined.  The  color  sample  included 
three  5"  frames  at  a  scale  of  1/10,000.  Coverage  was  very  nearly 
comparable  in  time,  but  not  in  line  of  flight,  nor  scale,  as 
already  noted.  However,  an  approximate  balance  of  target  image 
density  --  the  relation  of  target  image  size  to  image  field  - 
was  maintained.  Nine  targets  were  imaged.  Monitors  recorded 
total  counts  and  elapsed  times,  plus  confidence  levels.  Reported 
targets  were  checked  for  accuracy  of  interpretation. 

5.6.2  Task  8 

Subjects  were  asked  to  detect  and  count  all  water  buf¬ 
falo  imaged  in  coverage  of  a  Southeast  Asia  village  at  a 
scale  of  1/2500. 
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Ten  minute*  were  allowed  for  the  search.  The  test  samples  were 
strips  of  forty-eight  frames  of  70mm  film  collected  concurrently. 
While  this  imagery  was  also  used  for  the  count  of  sampans  in  Task 
5,  spot  checks  of  subjects  indicated  no  significant  carry-over 
from  one  task  to  the  other.  Monitors  checked  reports  for  "false 
alarms",  then  recorded  total  counts,  elapsed  time,  and  complete¬ 
ness  confidence  levels. 

5.6.3  Findings 

Considering  the  problem  as  a  whole,  no  statistically 
significant  differences  in  mean  scores  across  test  variables  were 
found.  Minor  differences  in  favor  of  monocular  interpretation 
and  panchromatic  imagery  were  shown  in  the  basic  raw  and  com¬ 
pleteness  mean  scores  and  in  favor  of  stereo  interpretation  and 
color  imagery  in  mean  speed  scores.  These  contradictions  nearly 
cancelled  one  another  in  the  adjusted  mean  scores.  Mean  accuracy 
was  uniformly  high  across  all  variables  in  keeping  with  the  de¬ 
sign  of  the  problem  (see  Figure  9).  Confidence-weighting  of 
basic  mean  raw  and  completeness  scores  reinforced  the  minor  dif¬ 
ferences  slightly  (see  Figure  10) . 

5.6.4  Discussion 

Examination  of  mean  scores  at  the  task  level  shows  that 
a  wide  divergence  between  tasks  was  masked  when  problem  level 
mean  scores  were  compiled.  The  task  mean  scores  agree  with  one 
another  only  in  showing  uniformly  high  accuracy  across  all  vari¬ 
ables  and  slight  bias  in  speed  scores  in  favor  of  stereo  viewing 
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and  color  imagery  Otherwise  Task  7  mean  scores  show  a  strong 
bias  for  monocular  viewing  and  a  stronger  one  for  panchromatic 
film,  while  Task  8  mean  scores  show  the  opposite  to  a  somewhat 
more  moderate  degree.  Reconsideration  of  test  materials  in  light 
of  subject  performance  leads  to  the  speculation  that  Task  8  was 
the  more  reliable  of  the  two  tasks  and  probably  yielded  more 
valid  indications  of  the  relative  merits  of  the  test  variables, 
mainly  because  its  imagery  samples  were  collected  concurrently. 
Conversely,  test  data  would  seem  to  indicate  that  in  the  solec 
tion  of  test  imagery  for  Task  7  the  attempt  made  to  balance  scale 
differences  by  maintaining  an  approximate  ratio  of  target  image 
size  to  overall  imagery  field  did  not  succeed,  and  that  the  test 
was  biased  in  favor  of  the  larger  scale  panchromatic  imagery.  On 
this  basis,  it  would  seem  that  the  problem  results  are  of  ques¬ 
tionable  value. 


S .  7  Problem  5.  Analysis:  Target  Detail  Pi  sc  riminat  i  on 

This  problem  was  one  of  analyzing  details  of  selected 
complex  target  images  and  determining  or  inferring  specified 
items  of  target  information.  The  target  search  which  is  normally 
part  of  operational  interpretation  was  ml  inline  ted  by  annotating 
targets  on  the  test  .imagery.  In  that  desired  items  of  target; 
information  were  extracted  on  request ,  the  analysis  was  closely 
controlled  and  focused  almost  exclusive  ly  on  the  .i  nterpretab  i  1  ity 
of  imagery  detail.  Information  was  requested  in  orde-  of  in¬ 
creasing  difficulty,  based  on  the  fineness  of  detail  to  be 
analyzed,  which  approached  and  in  some  cases  exceeded  the  appar¬ 
ent,  resolution  limits  of  the  test  imagery.  Selected  targets  were 
types  with  which  the  interpreters  had  some  familiarity,  and 
briefings  designed  to  eliminate  individual  differences  in  target 
knowledge  were  given  prior  to  each  task. 

S .  7  i  Task  9 

Subjects  were  asked  to  analyze  imagery  covering  five 
bridges  in  the  Annapolis  area  and  to  answer  as  many  as  possible 
of  seven  questions  about  each.  The  questions,  asked  in  an  ascend¬ 
ing  order  of  difficulty,  concerned  bridge  use,  construction  and 
size,  lip  to  thirty  minutes  were  allowed  for  the  task.  Film 
samples  were  comparable  strips  of  9"  vertical  photography  at  a 
scalo  of  1/20,000.  Twelve  frames  were  included  in  the  panchro¬ 
matic  sample  and  eleven  in  the  color  sample.  The  bridges  under 
question  were  annotated  on  each  sample.  Monitors  recorded  eacfo 
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response,  the  subject’s  confidence  in  its  accur'-urv  .  and  elapsed 
time  at  each  response. 

5.7,  2  Task  H) 

Subjects  were  required  to  study  and  iJentify  specified 
components  of  the  Brooklyn  Navy  Yard  imaged  in  1/40,000  scale 
vertical  photos.  They  were  asked  first  to  choose  among  several 
alternative  ident ' fixations  for  each  of  twelve  installations 
within  the  yard,  and  then  to  identify  and  count  the  various  types 
of  cranes  in  the  yard.  Keys  were  provided  for  both  parts  of  the 
task  and  explanations  of  shipyard  operations  in  the  aostract  were 
given  on  request.  Twenty  minutes,  exclusive  of  briefing  time, 
were  allowed  fur  the  problem.  Each  film  sample  consisted  of 
three  70mm  frames.  Samples  were  collected  concurrently,  Mori- 
tors  recorded  each  identification  along  with  response  time  and 
accuracy  confidence. 

5 . 7 . 3  Findings 

At  the  problem  level,  both  basic  and  confidence-weighted 
mean  adjusted  scores  showed  a  significant  difference  in  favor  of 
color  analysis.  The  differenc  a  in  favor  of  color  analysis  was 
also  shown  significantly  in  basic  speed  scores  and  to  a  minor 
extent  in  all  other  scores.  Monocular  viewing  was  significantly 
more  effective  than  stereo  viewing  in  confidence-weighted  mean 
adjusted  sco.es,  and  showed  a  minor  advantage  in  all  other  scores. 
No  reversals  took  place  when  scores  were  weighted  for  confidence. 
See  Figures  11  and  12. 
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The  advantage  of  color  film  in  overall  performance 
(see  nean  adjusted  scores)  was  due  very  largely  to  its  speed 
advantage,  though  color  film  also  showed  a  slightly  better  over¬ 
all  error  rate  (see  mean  raw  scores).  In  that  color  film  showed 
some  degree  of  advantage  over  panchromatic  film  in  all  aspects 
of  scoring  of  both  tasks  making  up  the  problem,  it  would  seem 
that  the  problem  level  results  were  reliable. 

The  results  which  showed  significant  overall  super¬ 
iority  of  monocular  viewing  over  stereo  viewing  at  the  problem 
level  may  be  somewhat  less  reliable,  in  that  the  task  level  basic 
scoring  showed  very  mixed  results  in  regard  to  the  effects  of 
viewing  mode.  At  this  level,  monocular  viewing  showed  a  marked 
advantage  over  stereo  viewing  only  in  the  speed  and  adjusted 
scores  for  Task  9  (detailed  analysis  of  bridges) ,  which  presented 
no  particular  need  for  sensing  depth  or  height. 

Subjects  seem  to  have  been  somewhat  optomistic  in  stat¬ 
ing  confidence  in  their  accuracy  on  this  problem.  While  accuracy 
scores  showed  an  error  rate  of  approximately  301,  confidence¬ 
weighting  discounted  scores  only  about  20%.  It  is  worth  noting 
that  this  rate  is  a  composite  of  a  very  high  confidence  in  per¬ 
formance  on  Task  9  and  a  more  accurate,  but  still  high,  confi¬ 
dence  estimate  on  Task  10.  The  disparity  between  problems, 
which  crossed  all  variables,  is  most  probably  due  to  the  wide 
difference  in  imagery  scales  between  the  tasks. 
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On  the  other  hand,  the  completeness  scores  in  the  70% 
range  indicate  that  subjects  failed  to  respond  in  a  significant 
number  of  situations.  In  Task  9,  failure  to  respond  was  com¬ 
pletely  voluntary,  in  Task  10  it  was  largely  due  to  failure  to 
detect  and  identify  all  the  cranes  within  the  shipyard  complex 
analyzed.  In  either  case  it  indicates  difficulty  in  completing 
the  required  work  which  would  seem  to  discourage  high  confidence 
estimates . 


5 . 8  Problem  6.  Analysis:  Single  Target  Identification 

The  core  of  this  problem  was  differentiation,  by  close 
analysis,  of  targets  of  a  specific  category  from  the  remainder 
of  a  broader  category.  The  desired  targets  were  distinguishable 
from  the  larger  field  by  easily  recognizable  signature  details. 
Imagery  scales,  however,  were  small  in  relation  to  the  size  of 
these  crucial  details  and  very  close  observation  of  the  test 
imagery  was  required. 

5.8.1  Task  11 

Using  the  same  Southeast  Asia  village  film  samples 
examined  in  Task  5  (5.5.1  above),  the  subject  was  asked  to  re¬ 
examine  the  sampans  previously  detected  and  determine  how  many 
were  manned.  Twenty  minutes  were  allowed  for  the  analysis. 

Samples  were  concurrent,  each  consisting  of  a  strip  of  forty- 
eight  70mm  frames  at  1/2,500  scale.  Subjects  reported  each 
group  of  ten  found,  a  final  count  and  their  confidence  in  the 
accuracy  of  their  interpretation.  Pourteeen  manned  sampans 

were  imaged. 

5.8.2  Task  12 

Subjects  were  asked  to  analyze  the  vessels  detected  in 
Bayonne  Harbor  in  Task  2  (5.3.2  above)  and  count  all  those  show¬ 
ing  open  holds.  Twenty  minutes  were  allowed  to  find  the  eight 
vessels  imaged  which  showed  this  detail.  The  imagery  samples 
were  concurrent,  each  consisting  of  three  70mm  rrames  at  1/165,000 
scale.  It  was  recognized  that  the  scale  was  extremely  small  for 
extraction  of  the  required  information,  and  subjects  were  reminded 
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that  they  might  decline  to  respond  if  they  felt  the  imagery 
could  not  sustain  the  required  analysis.  Subjects  were  instructed 
to  report  targets  in  groups  of  ten,  a  final  count  and  their  con¬ 
fidence  in  the  accuracy  of  their  interpretation. 

5 . 8 . 3  Findings 

No  significant  differences  were  found  in  any  aspect  of 
this  problem.  Performance  with  monocular  and  stereo  viewing  were 
very  similar  in  both  basic  and  confidence-weighted  scores,  though 
very  minor  reversals  took  place  between  them.  Except  for  speed 
scores,  where  color  analysis  showed  a  very  slight  advantage,  pan¬ 
chromatic  analysis  showed  a  minor  advantage  in  all  scores,  both 
basic  and  confidence-weighted.  See  Figures  15  and  14. 

5.8.4  Discussion 

Problem  level  results  masked  striking  differences  in 
ail  aspects  of  performance  between  Tasks  11  and  12.  Task  11 
mean  scores  showed  approximate  equality  between  the  viewing 
modes  and  a  modest  advantage  for  color  film  in  speed  and  overall 
performance.  Task  12  mean  scores,  on  the  other  hand,  showed  a 
modest  advantage  for  stereo  viewing  and  a  pronounced  advantage 
for  panchromatic  film.  In  addition.  Task  11  mean  scores  were, 
overall,  much  higher  than  Task  12  mean  scores.  For  example, 
while  the  average  of  mean  raw  scores  for  Task  11  was  about  90, 
the  average  of  Task  12  mean  raw  scores  was  about  2S.  This  dif¬ 
ference  was  accentuated  by  confidence -weighting. 


t 
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This  disparity  is  apparently  traceable  to  scale  dif¬ 
ferences  between  the  sets  of  imagery  --  1/2,500  in  Task  11  and 
1/165,000  in  Task  12  --  and  may  be  indicative  of  a  basic  consid¬ 
eration  in  comparing  panchromatic  and  color  films  in  aerial 
reconnaissance.  When  scale  is  large  in  relation  to  target  size, 
as  in  Task  11  and  Task  5  where  the  same  image  is  used,  there  is 
a  tendency  for  color  imagery  to  allow  faster  interpretation. 
However,  when  imagery  scale  is  small  enough  in  relation  to  target 
size  to  put  the  required  information  near  the  resolution  limits 
of  the  imagery  the  situation  is  reversed,  largely  because  any 
benefits  that  may  accrue  through  the  presence  of  color  clues  tend 
to  be  more  than  offset  by  its  lack  of  resolving  power  when  com¬ 
pared  to  fine-grained  panchromatic  film.  In  support  of  this  con¬ 
tention,  it  should  be  noted  that,  while  in  Task  11  all  subjects 
responded  under  all  conditions,  in  Task  12  the  "no  response"  rate 
rose  sharply,  but  more  so  for  color  than  for  pan  imagery.  While 
the  "no  response"  rate  for  color  imagery  was  76%,  it  was  only 
661  for  panchromatic  imagery. 
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5. 9  Problem  7.  Analysis:  Multiple  Target  Identification 

This  problem  involved  specific  identification  of  se¬ 
lected  targets  within  the  same  general  category.  Annotated  tar¬ 
gets  were  identified  by  analysis  and  categorization  of  details 
common  to  all.  No  target  search  was  required.  Details  which 
served  as  a  basis  for  identification  were  imaged,  at  best,  at 
small  scales  in  relation  to  size,  and  in  some  cases  were  beyond 
the  apparent  resolution  limits  of  the  test  imagery.  Details  were 
analyzed  in  order  of  increasing  difficulty  by  groups  covering  all 
targets  before  decisions  on  individual  target  identities  were 
called  for.  Keys  leading  from  detail  analysis  to  identification 
were  provided  for  this  last  step.  Success  depended  upon  inter- 
pretability  of  target  image  detail,  and  analysts  were  encouraged 
to  decline  to  continue  the  analysis  if  they  felt  the  image  quality 
would  not  allow  it. 

5.9.1  Task  13 

Subjects  were  asked  to  identify  the  class  of  each  of 
eight  submarines  by  determining  four  key  details  in  regard  to 
each  as  imaged  in  1/40,000  scale  photos.  The  imagery  samples 
were  concurrently  collected  and  each  consisted  of  four  70mm 
frames.  The  details  to  be  determined  were  hull  type,  conn¬ 
ing  tower  position,  hatch  openings,  and  length.  A  key  identi¬ 
fying  submarine  classes  by  these  details  was  provided  to  aid 
in  final  classification.  Monitors  recorded  responses, 
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confidence  in  the  accuracy  of  each  and  elapsed  time  for  each 
response.  Time  allowed  for  the  analysis  was  thirty  minutes. 


5.9.2  Task  14 

Using  1/40,000  scale  photos  of  LaGuardia  Airport,  New 
York  City,  subjects  were  asked  to  identify  ten  aircraft  on  the 
basis  of  wing  type,  number  of  engines,  engine  type,  and  employ¬ 
ment  on  the  field.  Each  of  the  foregoing  items  was  determined 
for  all  aircraft  before  final  identification  was  made  with  the 
aid  of  an  appropriate  key  and  mensuration.  Thirty  minutes  were 
allowed.  Imagery  samples  were  concurrently  collected  and  each 
included  five  70mm  frames.  Monitors  recorded  all  responses,  an 
estimate  of  confidence  in  the  accuracy  of  each  and  elapsed  time 
at  each  response. 

5.9.3  Findings 

At  the  problem  level,  scores  for  all  cases  of  the  test 
factors  were  very  similar,  whether  basic  or  confidence -weighted. 
No  statistically  significant  differences  occurred,  nor  did  con¬ 
fidence  weighting  reverse  any  of  the  minor  differences  shown.  In 
every  aspect  of  the  problem,  coaparison  of  basic  and  confidence- 
weighted  scores  indicated  that  mean  confidence  was  found  to  he 
high  in  relation  to  performance.  See  Figures  15  ahd  16. 

5.9.4  PUcuwlon 

Once  again,  results  at  the  problem  level  damped  out 
some  minor  differences  between  results  at  the  task  level.  In 
this  case,  while  Task  IS  (submarine  analysis)  results  showed  a 
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small,  but  consistant,  advantage  for  panchromatic  film;  Task  14 
(aircraft  analysis)  mean  scores  showed  a  minor  advantage  for 
color  film  in  all  aspects  of  scoring.  This  reversal  was  probably 
due  to  differences  between  the  particular  task  situations.  In 
Task  13  there  was  very  little  hue  difference  between  targets  and 
background,  so  color  imagery  offered  no  unique  advantages,  and 
its  lower  resolution  made  it  somewhat  inferior  to  panchromatic 
imagery  in  the  particular  case.  The  reverse  was  true  in  Task  14, 
where  some  hue  differences  separate  targets  from  background  and 
the  color  film  thus  offered  an  additional  clue  not  included  in 
the  pan  imagery.  The  incidence  of  failures  to  respond  tends  to 
reinforce  this  analysis:  in  Task  13  instances  of  failure  to 
respond  numbered  37  for  panchromatic  film,  66  for  color  film; 
while  in  Task  14  instances  numbered  80  for  panchromatic,  only 
25  for  color  film. 

As  in  Problem  5,  however,  these  substantial  "no  re¬ 
sponse"  rates,  and  the  reversal  between  tasks,  were  recorded 
alongside  uniform  confidence  in  accuracy,  which  was  somewhat  high 
in  comparison  to  performance. 
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Problem  8.  Delineation 


This  was  a  problem  of  categorizing  specified  superfi¬ 
cial  features  within  a  sizeable  rural  tract  according  to  a  given 
system  and  determining  boundaries  between  categories.  The  fea¬ 
tures  analyzed  were  generally  familiar  to  the  test  subjects ,  and 
the  systems  of  categorization  were  self-explanatory.  Thus,  the 
problem  focused  on  the  effectiveness  of  each  film  type  in  pro¬ 
viding  clues  for  boundary  delineation. 

5.10.1  Task  IS 

Subjects  were  asked  to  study  1/40,000  imagery  of  a 
tract  of  rural  land  near  Bennettsville ,  South  Carolina  and  deter¬ 
mine  the  type  of  ground  cover  predominating  within  designated 
squares  of  an  overlaying  grid.  Six  categories  were  considered, 
and  fifteen  minutes  were  allowed  for  the  analysis.  No  responses 
were  recorded  until  the  subject  indicated  he  had  completed  a  gen¬ 
eral  analysis.  Samples  were  congruent  and  consisted  of  three  9" 
vertical  frames  each.  Monitors  recorded  eighteen  responses, 
accuracy  confidence  for  each  and  total  elapsed  tine  for  the  prob¬ 
lem. 

5.10.2  Task  16 

Subjects  were  asked  to  map  ground  cover  types  within 
another  rural  tract  near  Bennettsville,  South  Carolina  in  six 
categories.  Thirty  minutes  were  allowOd  for  completion.  Mapping 
accuracy  was  then  measured  by  applying  a  grid  to  the  imp  and 
reading  out  the  predominant  ground  cover  type  shown  in  twelve 


selected  squares.  Samples  were  congruent,  each  consisting  of 
three  9"  vertical  frames  at  1/40,000  scale.  Monitors  recorded 
mapping  time,  twelve  responses  and  accuracy  confidence  for  each. 

5.10.3  Findings 

Mean  scores  of  all  types  were  very  similar  to  one 
another  at  the  problem  level,  except  for  the  case  of  basic  ad¬ 
justed  score  for  film  type,  where  color  analysis  showed  a  minor 
advantage.  No  statistically  significant  differences  were  re¬ 
corded.  Confidence-weighting  caused  no  important  reversals 
between  test  factors.  See  Figures  17  and  18. 

5.10.4  Discussion 

Minor  reversals  in  various  aspects  of  scoring  took 
place  between  Tasks  15  and  16,  but  results  were  similar  enough 
to  indicate  that  both  tasks  functioned  as  designed.  The  lack 
of  a  clear  advantage  for  one  film  type  or  the  other  may  be  attri¬ 
butable  to  the  fact  that  no  strong  hue  differences  normally  ekist 
between  the  ground  cover  categories  which  were  differentiated, 
so  that  color  clues  were  not  crucial.  At  the  sane  time,  the 
details  of  form  being  analyzed  were  not  so  small  in  scale  as 
to  make  the  better  resolution  of  pan  film  decisive. 

Throughout  the  problem,  confidence  in  accuracy  was 
uniformly  higher  than  was  justified  by  actual  performance.  There 
were  no  instances  of  failure  to  respond. 
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6.  CONCLUSIONS  AND  RECOMMENDATIONS 

It  appears  that  the  test  was  valid  and  produced  re¬ 
liable  results.  Recognizing  the  limitations  of  the  test,  extra¬ 
polations  of  the  results  to  real  reconnaissance  situations  art, 
nevertheless,  possible.  The  testing  program  yielded  no  com¬ 
pletely  unexpected  results.  In  particular,  the  test  revealed  no 
qualities  of  color  film  in  reconnaissance  applications  which 
were  not  previously  speculated  upon. 

Neither  color  nor  panchromatic  film  displayed  a  com¬ 
manding  advantage  in  aerial  reconnaissance,  either  generally  or 
in  relation  to  specific  tasks.  However,  such  modest  advantages 
as  were  found  were  all  in  favor  of  color  film.  These  advantages 
were  not  of  such  a  magnitude  as  to  indicate  an  immediate  shift 
in  reconnaissance  techniques.  Rather,  they  indicate  that  color 
photography  must  be  seriously  considered  by  reconnaissance  plan¬ 
ners.  That  is,  in  choosing  between  films  possible  gains  from 
color  film  use  must  be  weighed  against  additional  costs  in  light 
of  the  importance  of  particular  missions. 

Specifically,  the  test  indicated  the  following  in  re¬ 
gard  to  the  usefulness  of  color  film  in  aerial  reconnaissance: 

(1)  Use  of  color  film  instead  of  panchromatic  nay 

speed  interpretation  by  approximately  IS!. 

]■ 

(2)  Use  of  color  film  may  result  in  slightly  lower 
error  (Missed  target)  rates  in  searching 


operations,  the  degree  of  reduction  being  most 
directly  related  to  the  difference  in  hue  between 
target  and  background. 

(3)  Use  of  color  film  has  little  effect  on  the  accur¬ 
acy  of  analytical  interpretation,  except  when 
image  scale  is  small  or  marginal  in  relation  to 
target  size.  In  this  case,  accuracy  of  color 
film  interpretation  tends  to  be  lowered  in  rela¬ 
tion  to  panchromatic  film  analysis  presumably 
because  the  coarser  grain  structure  and  lower 
resolution  of  the  color  film  emulsion  lead  to 
higher  misinterpretation  rates  and  more  refusals 
to  respond. 

(4)  In  situations  where  analysis  is  attempted,  how¬ 
ever,  interpreter  confidence  is  not  significantly 
affected  by  the  type  of  film  presented  for  analy¬ 
sis. 


On  the  basis  of  this  test  it  is  recommended  that  color 
film  be  used  in  reconnaissance  operations :  where  colot  clues 
are  expected  to  be  significant  in  ‘determining  desired  informa¬ 
tion,  where  coverage  requirements  are  limited  enough  to  allow 
collection  at  noderato-to-larg#  scales  in  relation  to  target 
site  without  unduly  lengthening  the  mission,  and  where  analysis 
time  savings  the  range  of  ISt  are  daemed  significant. 


In  further  exploitation  of  the  results  of  this  prograa 
the  following  actions  are  also  reconnended: 

(1)  Investigation  of  the  speed-of -analysis  advantage 
recorded  for  color  films  and  ways  and  means  of 
increasing  it. 

(2)  Investigation  of  the  effectiveness  of  color  films 
as  compared  to  pan  films  in  searches  for  concealed 
or  camouflaged  tactical  military  targets. 

(3)  Inclusion  in  photo  interpretation  keys  of  infor¬ 
mation  on  target  color  as  an  aid  to  reconnaissance 
planning. 

(4)  Investigation  of  interactions  between  film  type 
and  viewing  mode  in  photo  interpretation. 

(5)  Investigation  of  the  usefulness  of  induced  color 
techniques  in  reconnaissance  imagery  interpreta- 


COLOR  RECONNAISSANCE  TESTING 


ADMINISTRATOR'S  INSTRUCTIONS  AND  SCRIPT 

Please  follow  these  instructions  es  closely  as  possible  in 
presenting  the  Color  Reconnaissance  Test  to  each  subject  assigned 
to  you.  By  doing  so,  you  will  insure  that  the  data  we  collect 
will  be  valid  and  the  test  we  have  worked  so  long  to  prepare  will 
be  successful  in  advancing  the  state-of-the-art  of  aerial  recon¬ 
naissance. 

Before  each  subject  reports  to  take  the  test,  check  to  be 
sure  that  you  have  everything  listed  on  the  check  list;  test 
inagery ,  equipment ,  graphics  and  fonts. 

When  the  subject  is  ready  to  begin  ask  hist  first  to  complete 
the  Subject  Biography.  This  should  take  3-5  minutes.  Check  the 
for*  for  completeness  and  legibility  before  accepting  it. 

Reed  the  following  general  instructions  to  the  subject: 


Hkk Yil  are  ABOUT  TO  IttBfN  18  MADE  UP  OP  17 


STEREOSCOPIC  STUDY.  YOU  WILL  BE  GIVEN  APPROPRIATE  IN¬ 
TERPRETATION  TOOLS,  KEYS,  AND  OTHER  GRAPHICS  FOR  BACH 
PROBLEM.  PERFORMANCE  WILL  BE  MEASURED  FOR  ACCURACY, 
COMPLETENESS  AND  SPEED.  TO  SAVB  YOU  TIME  AND  TO  INSURE 
ACCURATE  RECORDING,  SOLUTIONS  TO  EACH  PROBLEM  WILL  BE 
RECORDED  BY  THE  TEST  MONITOR.  HE  WILL  ALSO  STAND  BY 
THROUGHOUT  THE  TEST  TO  ANSWER  QUESTIONS  THAT  MAY  ARISE, 

KEEP  TRACK  OF  TIME  AND  PRESENT  THE  PROBLEMS  IN  SEQUENCE. 

•*  » 

PLEASE  DO  NOT  DISCUSS  THIS  TEST  WITH  OTHERS  UNTIL  WE 
HAVE  COMPLETED  ALL  TESTING.  FOR  BEST  RESULTS: 

1.  UNDERSTAND  EACH  PROBLEM  BEFORE  YOU  START  WORK 
ON  IT. 


2.  BE  SURE  THE  TEST  IMAGERY  IS  PROPERLY  ORIENTED  ON 
YOUR  LIGHT  TABLE  AND  COVERED  WITH  AN  ACETATE  OVERLAY. 

3.  MAKE  FULL  uSB  OF  THE  EQUIPMENT  AND  AIDS  SUPPLIED* 
AND  MAKE  ANY  NOTES  OR  OVERLAYS  WHICH  YOU  FEEL  WILL  BE 
HELPFUL  TO  YOU. 


4.  REPORT  YOUR  ANSWERS  TO  THE  MONITOR  IN  THE  MANNER 
REQUESTED  AS  QUICKLY  AS  POSSIBLE  WITHOUT  SACRIFICING 
COMPLETENESS  OR  ACCURACY. 


A.  ESTIMATE  YOUR  CONFIDENCE  IN  BACH  ANSWER  AS 

ACCURATELY  AS  POSSIBLE. 

DO  YOU  HAVE  ANY  QUESTIONS  BEFORE  WE  BEGIN? 

Answer  any  questions  as  briefly  as  possible. 

When  all  questions  have  been  disposed  of,  give  the  subject 
the  pre-test  problea  imagery.  Orient  the  imagery  properly  on  the 
light  table,  see  that  it  is  covered  by  an  overlay,  and  read  the 
following  instructions: 

THIS  IS  A  PROBLEM  FOR  MONOCULAR  INTERPRETATION. 

YOU  HAVE  UP  TO  5  MINUTES  TO  EXAMINE  THE  IMAGERY.  THEN 

5  QUESTIONS  WILL  BE  ASKED.  RESPOND  AND  INDICATE  A  CON¬ 
FIDENCE  LEVEL  FOR  EACH  ANSWER  AS  QUICKLY  AS  POSSIBLE. 

Retford  starting  time  on  the  subject's  score  sheet.  ''"Ui  him 
Know  when  3,  4,  and  S  minutes  have  passed  and  then  ash  the  qmes- 
tioas  on  the  problem  sheet.  As  questions  are  answered  recerd  • 


Hake  sure  protective  overlays  aro  In  placo. 


2,  Indicate  the  node  of  study  to  be  used  -  mono  or 
stereo . 

3.  Follow  any  special  instructions  given  below  for  the 
problem. 


4.  Answer  any  questions  briefly. 


5.  Note  the  time  of  starting,  the  subject's  responses, 
the  tiae  of  each  response  to  the  nearest  30  seconds,  and 
the  subject's  confidence  level  in  the  proper  places  on  the 
response  record. 


6.  Collect  all  fila  and  collateral  data  on  each  prob¬ 
lem  as  it  is  completed  and  replate  it  carefully  in  your  file 
for  re-use. 

7.  If  grease  pencil  notes  have  been  made  oh  the  pro¬ 
tective  overlays,  assure  that  the  subject  cleans  the  shield 
between  problems. 


fail  1.  After  giving  the  subject  the  film  and  the  appropriate 
instructions  for  noma  or  stereo  study  read  tfip  following  instruc- 


THESE  PHOTOS,  THAT  IS,  THE  LARGER  LAND  AREA  ON  ONE  SIDE 
OF  THB  RIVER  ONLY,  INDICATE  EACH  TEN  AS  YOU  COUNT  THEM, 

AND  WITH  YOUR  FINAL  TOTAL,  RECORD  ALSO  YOUR  LEVEL  OF 
CONFIDENCE  IN  YOUR  SOLUTION  TO  THE  WHOLE  PROBLEM.  BE 
CAREFUL  TO  COUNT  EACH  LOT  ONLY  ONCE,  AND  EXCLUDE  DRIVE¬ 
WAYS  TYPICAL  OF  ONE  FAMILY  HOUSES.  YOU  HAVE  UP  TO  20 
MINUTES  TO  COMPLETE  THIS  PROBLEM,  BUT  WORK  AS  QUICKLY  AS 
POSSIBLB.  ANY  QUESTIONS? 

Answer  questions  as  »,jpropriate ,  point  out  a  saaple  target 
not  within  the  test  area,  check  starting  tine  and  signal  start. 
Announce  tine  remaining  at  S  ninute  intervals. 

Task  2.  In  giving  the  subject  the  test  filn,  be  sure  to  indi¬ 
cate  clearly  that  only  the  area  covered  by  the  center  frame  is  to 
be  studied.  Then  read  the  following  Instructions: 

THE  PROBLEM  HERB  IS  TO  DETERMINE  THB  NUMBER  OF  SBLF- 
PR0PELLED  SKIPS  SHOWN  IN  THE  CENTRAL  FRAME.  EXCLUDE  ANY 
BARGES,  SMALL  CRAFT  UP  TO  THE  SIZE  OF  TUGS  AND  BOATS  FROM 
THE  COUNT,  BUT  INCLUDE  ALL  MAJOR  VESSELS  RB6ARDLESS  OP 
STATUS  OR  STATE  OF  MAINTENANCE.  INDICATE  GROUPS  OF  TEN 
AS  M  COUNT  THEM,  AND  RECORD  AN  OVERALL  LEVEL  OF  CONFI- 
DENCB  WITH  YOUR  TOTAL  COUNT.  ANT  QUESTIONS?  YOU  HAVE 
UP  TO  10  MINUTB8  FOR  THIS  PROBLEM. 


Task  3.  Give  the  subject  the  problea  film  and  orient  it  pro¬ 
perly.  Present  the  target  key  sheet  and  read  the  following  in¬ 
structions  : 

THIS  IS  A  MONOCULAR/ STEREOSCOPIC  PROBLEM.  SEARCH 
THE  TEST  FILM  FOR  THE  TARGET  TYPES  LISTED  ON  THE  KEY  AND 
REPORT  INDIVIDUAL  TARGETS  AS  SOON  AS  YOU  FIND  THEM.  IT 
IS  RECOMMENDED  THAT  YOU  SEARCH  FOR  TARGET  TYPES  ONE  AT 
A  TIME.  INDICATE  A  CONFIDENCE  LEVEL  FOR  THE  COMPLETE¬ 
NESS  OF  YOUR  FINAL  COUNT  OF  EACH  TARGET  TYPE.  BEFORE 
STARTING,  CHECK  THE  LIST  AND  MAKE  SURE  YOU  UNDERSTAND 
EACH  TARGET  TYPE  LISTED*  YOU  HAVE  UP  TO  40  MINUTES  FOR 
THIS  TASK,  BUT  COMPLETE  YOUR  SEARCH  AS  QUICKLY  AS  POSSI¬ 
BLE  WITH  ACCURACY.  ANY  QUESTIONS? 

Answer  questions,  assure  that  the  problea  is  understood,  check 
time  .and  signal  starting  tine.  Announce  tine  after  20  Minutes  in 
g  ainute  intervals. 

When  the  subject  signals  that  he  has  finished,  consult  with 
hia  on  the  location  of  the  reported  targets.  Check  against  the 
garget  plot  and  Merd  actual  targets  and  false  Rsaeaber 

tdit  late  is  a  correct  response  la 'Mb  cases. 


CONSTRUCTION  SITBS.  SITBS  MAT  BB  TYPIFIED  BY  BVIDBNCB  OF 
DIGGING,  PRBSBNCB  OF  CONSTRUCTION  BQUIPMBNT  OR  MATERIALS , 

BY  PARTIAL  STRUCTURES ,  OR  BY  ANY  COMBINATION  OF  THESE 
ELEMENTS.  INCLUDE  IN  YOUR  COUNT  ALL  SITES  WHETHER  OR  NOT 
WORK  IS  ACTUALLY  GOING  ON  IN  THE  PHOTOS  AND  NOTE  LOCA¬ 
TIONS  ROUGHLY  ON  THE  PROTECTIVE  OVERLAY .  YOU  WILL  HAVE 
UP  TO  20  MINUTES  TO  MAKE  YOUR  SEARCH.  ANY  QUESTIONS? 

Answer  questions,  then  signal  starting  tine.  Announce  tine 
at  10  and  15  ninutes.  When  the  subject  signals  that  he  is  fin¬ 
ished,  check  locations  of  reported  sites  for  accuracy,  and  adjust 
score  for  any  instances  of  targets  lunped  together,  etc. 

Task  5.  Mount  the  test  filn  on  the  light  table  and  assure  that 
a  protective  overlay  is  available.  Read  the  following  instruc¬ 
tions: 

THIS  IS  A  MONOCULAR/STEREOSCOPIC  PROBLEM.  THIS  FUJI 
COVERS  A  VILLAGE  SITE  IN  SOUTHEAST  ASIA.  YOUR  PROBLEM 
IS  TO  COUNT  ALL  THE  SAMPANS  IMAGED  ON  THE  48  FRAMES  YOU 
HAVE  BEEN  GIVEN.  COUNT  SAMPANS  BOTH  IN  AND  OUT  OF  THE  . 
WATER,  WHETHER  SERVICEABLE  OR  NOT,  BUT  BE  CAREFUL  TO 
COUNT  EACH  VESSEL  ONLY  ONCE.  REPORT  EACH  10  SAMPANS  AS 
YOU  FIND  THEM  AND  A  FINAL  TOTAL.  YOU  HAVE  UP  TO  2$ 

MINUTES  TO  COMPLETE  THE  COUNT  BUT  YOU  SHOULD  WORE  AS 

—  Juki  ^  — 

QUICKLY  AS  POSSIBLE  •  STAYS  All  OVMR**ALL  ODMP1LKHCS  LKVKL 
IN  TOtyE  1HTERPRITATICNI  WHEN  YOU  FXHXNE^S'!:  Ail  QUSSYlUHSf 


Answer  questions,  point  out  one  easy-to-find  saapan  and  sig 
nal  starting  tiae.  Announce  tiae  at  15  and  20  ainutes. 

Task  6.  Mount  the  test  fila  on  the  light  table  and  assure  that 
a  clean  protective  overlay  is  available.  Read  tho  following  in¬ 
structions  : 

THIS  IS  A  MONOCULAR/STEREOSCOPIC  PROBLEM.  THIS  FILM 
COVERS  A  SEMI -RURAL  AREA  IN  THE  UNITED  STATES.  THE  PROB¬ 
LEM  IS  TO  COUNT  THE  TRANSMISSION  LINE  TONERS  IMAGED  IN 
THE  STRIP  OF  12  FRAMES  WHICH  YOU  HAVE  BEEN  GIVEN.  BE 
CAREFUL  TO  COUNT  BACH  TOWER  ONLY  ONCE.  REPORT  EACH  TEN 
TOWERS  COUNTED,  YOUR  TOTAL  COUNT,  AND  YOUR  LEVEL  OF  CON¬ 
FIDENCE  IN  THE  OVERALL  ACCURACY  OF  THE  COUNT.  YOU  WILL 
HAVE  UP  TO  IS  MINUTES  TO  COMPLETE  THE  SEARCH.  ANY  QUES¬ 
TIONS? 

Answer  questions  briefly;  then  eignai  the  starting  tiae. 
Announce  fine  at  $  and  10  ainutes. 

Task  7.  Distribute  the  test  f lia,  orient  it  properly,  and  aake 
sure  that  a  clean  protective  overlay  is  in  place.  Then  road  the 
following  instructions : 


COUNT  AND  AN  OVERALL  LEVEL  OP  CONFIDENCE  IN  ITS  ACCUR¬ 
ACY.  YOU  WILL  HAVE  UP  TO  10  MINUTES  TO  COMPLETE  THIS 
PROBLEM.  ANY  QUESTIONS? 


Answer  questions,  then  signal  starting  time.  When  the  sub¬ 
ject  indicates  completion,  check  his  detections  against  the  tar¬ 
get  plot  for  accuracy  and  record  false  alarms  if  necessary. 

Task  8.  Mount  the  test  film,  properly  oriented,  on  the  light 
table  and  cover  with  a  clean  overlay.  Read  the  following  instruc 
t ions : 


INIS  IS  A  MONOCULAR/STEREOSCOPIC  PROBLEM.  YOU  ARB 
TO  FIND  AND  COUNT  THE  WATER  BUFFALO,  IF  ANY,  WHICH  ARE 
IMAGED  IN  THE  VILLAGE  COVERED  BY  THE  20  FRAMES  YOU 
WILL  EXAMINE.  WATER  BUFFALO  ARE  VARIOUS  SHADES  OF 

* 

LIGHT  GREY  IN  COLOR,  AND  ABOUT  THE  SIZE  AND  CONFORMATION 
OF  A  LARGS  CON.  THEY  MIGHT  BE  SOUND  ANYWHERE  IN  THE  AREA 
IMAGED.  COUNT  EACH  ANIMAL  ONLY  ONCE.  REPORT  GROUPS  OF 
TEN,  THE  TOTAL  COUNT  AND  YOUR  CONFIDENCE  IN  ITS  ACCURACY. 
YOU  MILL  HAVE  UP  TO  10  NINUTBS  TO  COMPLETE  YOUR  SEARCH.- 
ANY  QUESTIONS? 


Answer  questions,  then  signal  starting  time.  When  the  sub- 
completion,  check  the  location  of  his  targets,  and 


the  question  sheet  end  bridge  key,  end  read  the  following  instruc- 
tions: 

THIS  IS  A  MONOCULAR/STERBOSCOPI C  PROBLEM,  YOUR 
TASk  IS  TO  STUDY  THE  NUMBERED  BRIDGES  IN  ORDER  AND  ANSWER 
AS  MANY  AS  POSSIBLB  OF  THE  7  QUESTIONS  WHICH  WILL  BB 
ASKED  ABOUT  BACH  ONE.  GIVE  ONLY  THOSE  ANSWERS  WHICH  YOU 
CAN  VERIFY  FROM  THE  IMAGERY  AND  INDICATE  YOUR  CONFIDENCE 
IN  EACH  ONE.  DON'T  GUESS.  YOU  WILL  HAVE  UP  TO  30  MIN¬ 
UTES.  ANY  QUESTIONS? 

Answer  questions  briefly,  check  time  end  signal  start.  From 
your  question  sheet  ask  each  question  in  ordqy,  stating  any  alter¬ 
native  answers  give  .  Make  sure  that  the  subject  studies  the  pro¬ 
per  bridges.  Clarify  questions  as  necessary,  blit  .avoid  any  dis¬ 
cussions  of  interpretation.  Be  sure  to  record  a  confidence  level 
for  each  answer  given. 

i  * 

»  r 

Task  10.  Mount  the  test  photos  in  proper  orientation  and  cover 
with  an  overlay.  Give  the  subject  a  target  diagram  and  key.  Read 

,i|j!'"’  li'lu  ii 1 1  !  :  .  i,i  . . .  '  ,  '"¥$ 


the  following  instructions : 


ANSWERS:  IN  OTHER  WORDS,  DON'T  GUESS.  FOR  BACH  ANSWER, 

STATE  YOUR  LEVEL  OF  CONFIDENCE.  ANY  QUESTIONS? 

Answer  questions  briefly,  check  tine  and  start.  Be  sure  that 
the  subject  correctly  isolates  each  area  to  be  studied,  then,  con¬ 
sulting  your  answer  sheet,  ask  each  question  in  order,  including 
alternative  answers  where  a  choice  is  to  be  made.  Be  sute  to  re¬ 
cord  confidence  levels  for  each  answer. 

Teak  11.  This  problem  will  follow  Task  S  and  uses  the  sane  ima¬ 
gery.  Read  the  following  instructions:  \ 

THE  NEXT  PROBLEM  IS  MONOCULAR/STERBOSCOPIC.  NOW 
THAf  YOU  AVB  COUNTED  ALL  SAMPANS ,  COUNT  THE  NUMBER  WHICH 

Are  h  that  is,  have  pbople  in  them  or  close  to  them. 

INDICATE  BACH  TEN  AS  YOtl  COUNT  THEM,  A  TOTAL  COUNT  AND 
YOUR  L6/BL  0#  CONFIDENCE  IN  ITS  ACCURACY.  YOU  HAVE  UP  TO 
20  MINUTES.  ANY  QUESTIONS?  . 


Explain  the  instructions  is  necessary,  signal  tine  pnd  start. 
Announce  tine  at  10  and  IS  minutes. 


OPEN  HOLDS.  INDICATE  EACH  TEN  AS  YOU  CMY  THEM,  A  ^ 

TAL,  AND  YOUR  OVERALL  LEVEL  OF  CONFIDENCE  IN  ITS  ACCUR¬ 
ACY.  YOU  WILL  HAVE  UP  TO  20  MINUTES  TO  FINISH  YOUR 
COUNT.  ANY  QUESTIONS? 

Make  sure  the  target  type  is  understood,  Chock  tiae  and  start. 

Task  13.  Mount  test  photos  in  proper  orientation  and  coyer  with 
a  clean  overlay.  Give  the  subject  a  question  sheet  and  sutttarine 
key.  Read  the  following: 


THIS  IS  A  MONOCULAR/STEREOSCOPIC  PROBLEM.  YOUR 
TASK  IS  TO  ANSWER  BACH  OF  FOUR  QUESTIONS  IP  POSSIBLE  IN 
REGARD  TO  BACH  OF  TOE  NUMBERED  VESSELS.  ,  GIVE  ONLY  THCX  : 
ANSWBAS  WHICH  THE  IMAGERY  SUPPORYS.  DON'T  GUBSS.  IN¬ 
DICATE  YOUR  CONFIDENCE  IN  BACH  ANSWER.  YOU  BILL  HAVE 


UP  YO  SB  MINUTES.  ANY  QUESTIONS? 


Explain  each  question,  if  necessary,  as  it  is  given.  Have 
the  subject  answer  each  question  for  all  fS^petp  before  noving  to 
the  following  question.  Record  a  confidence  level  ter  each  answer 
■1VM  u*  th.  tia.  tA.11  «n  .B.W.T.  ta  ..ch  «W.»ti.B  ar»  t*M4**. 

1  II11"'  '' 

Mii-  *»**  tall  phot..  In  propar  orlratatloa.  co»«r  aiti  aa 
mrttr,  aa*  *W*  Ik*  nb)Mt  a  tatpat  ili|na,  aa*  airctaft  Ws' 
t«a*  th.  fatlMar . :  '  '  ^  :  ■; 


BACH  0  iHB  TEN  NUMBERED  AIRCRAFT-  AVOID  GUESSING,  A^D 
INDICATE  YOUR  CONFIDENCE  IN  EACH  ANSWER  YOU  GIVE.  YOU 
WILL  HAVE  UP  TO  30  MINUTES.  ANY  QUESTIONS? 

Clarify  questions,  if  necessary,  as  they  are  given.  Ask 
each  question  in  regard  to  all  aircraft  before  moving  to  the  fol¬ 
lowing  question.  Be  sure  to  record  confidence  for  each  answer 
and  elapsed  tine  at  completion  of  each  question. 


Task  15.  Mount  the  test  film,  properly  oriented  (marginal  data 
readable)  on  the  light  table.  Locate  the  test  grid  over  the  film. 
Cover  with  clean  shield.  Road  the  following  instructions: 


THIS  IS  A  MONOCULAR/ STEREOSCOPIC  PROBLEM-  YOUR 
TASK  IS  Tp  STUDY  T^B  AREA  COVERED  BY  THE  GRID  AND  IDEN¬ 
TIFY  THE  PREDOMINANT  CATEGORY  OF  GROUND  COVER  IMAGED 
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